I see what you're saying: the integration of complex speech and scenes during language comprehension.

نویسندگان

  • Richard Andersson
  • Fernanda Ferreira
  • John M Henderson
چکیده

The effect of language-driven eye movements in a visual scene with concurrent speech was examined using complex linguistic stimuli and complex scenes. The processing demands were manipulated using speech rate and the temporal distance between mentioned objects. This experiment differs from previous research by using complex photographic scenes, three-sentence utterances and mentioning four target objects. The main finding was that objects that are more slowly mentioned, more evenly placed and isolated in the speech stream are more likely to be fixated after having been mentioned and are fixated faster. Surprisingly, even objects mentioned in the most demanding conditions still show an effect of language-driven eye-movements. This supports research using concurrent speech and visual scenes, and shows that the behavior of matching visual and linguistic information is likely to generalize to language situations of high information load.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

I "hear" what you're "saying": Auditory perceptual simulation, reading speed, and reading comprehension.

Auditory perceptual simulation (APS) during silent reading refers to situations in which the reader actively simulates the voice of a character or other person depicted in a text. In three eye-tracking experiments, APS effects were investigated as people read utterances attributed to a native English speaker, a non-native English speaker, or no speaker at all. APS effects were measured via onli...

متن کامل

The Effects of Task Complexity on English Language Learners’ Listening Comprehension

This article reports on the findings of a study that investigated the impact of manipulating task performance conditions on listening task performance by learners of English as a foreign language (EFL). The study was designed to explore the effects of changing complexity dimensions on listening task performance and to achieve two aims: to see how listening comprehension task performance was aff...

متن کامل

Teaching approaches to Computer Assisted Language Learning

Computers have been used for language teaching ever since the 1960's.Learning a second language is a challenging endeavor, and, for decades now, proponents of computer assisted language learning (CALL) have declared that help is on the horison. We investigate the suitability of deploying speech technology in computer based systems that can be used to teach foreign language skills. In this case,...

متن کامل

in Foundations of Speech Act Theory

Like Humpty Dumpty, many philosophers take pride in saying what they mean and meaning what they say. Literalism does have its virtues, like when you're drawing up a contract or programming a computer, but generally we prefer to speak loosely and leave a lot to inference. Language works far more efficiently that way. Two Kinds of Looseness It helps if you can rely on people not to take you too l...

متن کامل

Comprehension of Passive Structure: Study of Children with and without Specific Language Impairment

Objectives: Specific language impaired children, despite being normal in cognitive and neurological characteristics, and also normal levels of hearing, experience multiple problems in syntax comprehension. This study compared the passive comprehension as one of Syntactic Structures in Persian-speaking typically developing children and Specific language impaired children. Methods: 10 children w...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Acta psychologica

دوره 137 2  شماره 

صفحات  -

تاریخ انتشار 2011